Quantum Phases of the Planar Antiferromagnetic J1-J2-J3 Heisenberg-Model 



O 

(N 
•*-> 
O 

O 

in 



CO 



1 

c 

o 
o 



> 

00 
On 
O 
CO 



Johannes Reuther/'B Peter Wolflc, 1 Rachid Darradi, 2 Wolfram Brenig, 2 Marcelo Arlego, 3 and Johannes Richter 4 

1 Institut fur Theorie der Kondensierten Materie, 
Karlsruhe Institute of Technology, 76128 Karlsruhe, Germany 
2 Institut fur Theoretische Physik, Technische Universitat Braunschweig, 38106 Braunschweig, Germany 
Departamento de Fisica, Universidad Nacional de La Plata, C.C. 67, 1900 La Plata, Argentina. 
* Institut fur Theoretische Physik, Universitat Magdeburg, 39016 Magdeburg, Germany 

(Dated: October 18, 2010) 

We present results of a complementary analysis of the frustrated planar J1-J2-J3 spin- 1/2 
quantum-antiferromagnet. Using dynamical functional renormalization group, high-order coupled 
cluster calculations, and series expansion based on the flow equation method, we have calculated 
generalized momentum resolved susceptibilities, the ground state energy, the magnetic order pa- 
rameter, and the elementary excitation gap. From these we determine a quantum phase diagram 
which shows a large window of a quantum paramagnetic phase situated between the Neel, spiral and 
collinear states, which are present already in the classical J1-J2-J3 antiferromagnet. Our findings 
are consistent with substantial plaquette correlations in the quantum paramagnetic phase. The 
extent of the quantum paramagnetic region is found to be in satisfying agreement between the three 
different approaches we have employed. 

PACS numbers: 75.10.Jm, 75.50.Ec 



I. INTRODUCTION 

The search for exotic quantum phases is one of the 
main interests in the study of spin systems with compet- 
ing interaction. Ultimately this search may uncover spin 
liquids (SL) without any magnetic order or long range 
correlations. En-route however, many interesting quan- 
tum paramagncts (QP) lie, which are not magnetically 
ordered, however exhibit broken spatial symmetries with 
respect to short range magnetic correlations, either spon- 
taneously or by virtue of the lattice structure, i.e. valence 
bond crystals (VBC) or solids (VBS). In two dimensions 
a paradigmatic system in this context is the antiferro- 
magnetic (AFM) J1-J2 model on the square lattice with 
frustrating diagonal exchange. As a function of the sin- 
gle parameter j = J2/J1 this model is widely accepted to 
undergo a transition from a Neel state at j < 0.4, to a QP 
phase for 0.4 < j < 0.6 and to a collinear AFM phase be- 
yond that. However, even two decades after first analysis 
of thisi* 2 -, no consensus has been reached on the nature 
of the QPphase and the type of transition into it, see 
e.g. Ref. y and references therein. Possible QP phases 
in the J1-J2 model include a columnar dimcr VBC 4 -, a 
plaquette VBC£, but also a SlA For the Neel to VBC 
transition deconfined quantum criticality has been pro- 
posed as a novel scenario^. Experimentally, the J1-J2 
model may be realized in several layered materials such as 
Li 2 VO(Si,Ge)0^, VOMoO^, and BaCdVO(P0 4 )2^-- 

One approach to shed additional light on the QP region 
of the J1-J2 model is to embed its analysis into a larger 
parameter space. In this context the J1-J2-J3 model 
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has become of renewed interest recently. Sj refers to 
spin- 1/2 operators on the sites of the planar square lat- 



FIG. 1: a) J1-J2-J3 model. Solid dots refer to lattice sites. 
Only representative third-nearest-neighbor exchange paths 
are depicted, b) The classical phase diagram of the J\-J%- 
J% model. 



tice shown in Fig.[T]a), and Ji,2,3 ar e exchange couplings 
ranging from first, i.e. up to third-nearest neigh- 

bors, i.e. For the remainder of this work we will 

focus on the AFM case, i.e. Ji 2 3 > and set J x = 1. 

Classically, the J1-J2-J3 model allows for four ordered 
phases^—, comprising a Neel, a collinear, and two types 
of spiral states which are depicted in Fig.[T]b). Except for 
the transition from the diagonal (q, q)-spiral to the (n, q)- 
spiral state, which is first order, all remaining transitions 
are continuous. Early analysis of quantum fluctuations 1 ^ 
found the Neel phase to be stabilized by J3 > 0, with the 
end-point of the classical critical line J3 = 1/4 — J2/2 at 
J 2 = shifted to substantially larger values of J3. First 
indications of non-classical behavior for finite J3 > 
where obtained at J 2 = 0. A 'spin-Pcierls state' was 
found in exact diagonalization (ED) studies in the vicin- 
ity of J3 ~ 0.7, between the Neel phase and the diagonal 
spiralis. Monte-Carlo and 1/N expansion resulted in a 
succession of a VBC and a Z 2 spin-liquid in this region 1 ^. 
QP behavior was also conjectured at finite J2, J3, along 
the line J2 = 2J3 using Schwingcr-Bosons 1 ^. More re- 
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cent analysis, based on ED and short-range valence bond 
methods found an s-wave plaquette VBC, breaking only 
translational symmetry, along the line Ji + J3 = 1/2, 
up to J2 < 0.25^. This VBC's region of stability was 
then studied by series expansion in the ( J2, J3) planed. 
Results from projected entangled pair states (PEPS) at 
J2 = supported the notion of an s-wave plaquette along 
the J3-axis2i. However, the symmetry of the QP state re- 
mains under scrutiny, since a truncated quantum-dimcr 
models indicates that the potential plaquette VBC has 
a sublcading columnar dimer admixture in the vicinity 
of J2 k J3 ~ 0.25, similar to ED studies^. This implies 
broken translation and rotation symmetry. For J2 > 0.5, 
ED shows strong columnar dimer correlations^. Finally, 
the order of the transitions from the QP into the semi- 
classical phases, and in particular to the diagonal spiral, 
remain an open issue. 

In this work we intend to further clarify the extent of 
the QP regime, using three complementary techniques, 
namely, functional rcnormalization group (FRG), cou- 
pled cluster methods (CCM), and scries expansion (SE). 
These methods display rather distinct strengths and lim- 
itations which we will combine. CCM and SE are meth- 
ods which operate inherently in the thermodynamic limit, 
however require extrapolation with respect to cluster size 
or expansion order. The FRG method is in principle also 
formulated in the thermodynamic limit, but its numerical 
implementation requires one to restrict the spin correla- 
tion length to a maximal value, which is much larger than 
system sizes in ED studies. At present neither of these 
methods alone allows to investigate the full range of semi- 
classically ordered and QP states, however their combi- 
nations provides completive information on the quantum 
critical lines bounding QP regions: FRG can signal mag- 
netic instabilities of a paramagnetic state, the SE limits 
the QP region, and CCM clarifies the stability of part 
of the ordered states. As a main result of this paper we 
will show that the quantum critical lines agree remark- 
ably well between all three methods, establishing part of 
the quantum paramagnetic region rather firmly. Unfor- 
tunately none of our approaches allow to determine the 
symmetry of the QP state unbiased, which leaves this an 
open issue. The paper is organized as follows. In section 
II we provide for a brief technical account of all three 
approaches. Section III is devoted to a discussion of the 
results. We conclude in section IV. 



II. METHODS 

In this work we mainly employ three methods to 
deal with quantum spin systems, namely FRG, see sec- 
tion III Al which uses a diagrammatic, dynamical renor- 
malization group approach, CCM, see section Hi B[ which 
is a cluster expansion method employing an exponential 
ansatz for the correlated ground state, and finally SE in 
the exchange coupling constants, see section Hi CI based 
on continuous unitary transformations. In the following 



we briefly explain each of these methods. 

A. Functional Renormalization Group Method 

The first approach to tackle the system is based on the 
functional renormalization group (FRG) in conjunction 
with a pscudo-fcrmion representation of the 5 = 1/2 spin 
operators. A detailed description of the FRG in general 
is given e.g. in Ref. [24|. For an implementation of FRG 
with pseudo fermions and an application to the J1-J2- 
Heisenberg-model, we refer the reader to Ref. [25|. This 
approach is guided by the idea to treat spin models in the 
framewok of standard Feynman many body techniques. 
In order to be able to apply the methods of quantum 
field theory (Wick's theorem), we use the pscudo-fcrmion 
representation of spin operators, 

a/3 

(2) 

where fa and /j, are the annihilation operators of the 
pseudo fermions and are the Pauli-matrices. This 
representation requires a projection of the larger pseudo- 
fermion Hilbcrt space (4 states per lattice site) onto the 
physical subspace of singly occupied states (2 states). 
At zero temperature we may perform this projection by 
putting the chemical potential of the pseudo fermions 
to zero. Empty or doubly occupied states are acting 
like a vacancy in the spin lattice and are therefore as- 
sociated with an excitation energy of order J. Quan- 
tum spin models are inherently strong coupling models, 
requiring infinite resummations of perturbation theory. 
The simplest such approach is mean-field theory of the 
spin susceptibility, which is known to provide qualita- 
tively correct results in the case that a single type of 
order is present. On the other hand, frustrated systems 
are characterized by competing types of order. This is 
a situation when FRG is a powerful tool, as it allows 
to resum the contributions in all the different (mixed) 
channels in a controlled and unbiased way. The first step 
is the introduction of a sharp infrared frequency cutoff 
for the Matsubara Green's functions. FRG then gen- 
erates a formally exact hierarchy of coupled differential 
equations for the one-particle- irreducible vertex functions 
where the frequency cutoff A is the flow parameter. In 
Fig. [2] we show the two first equations of the hierarchy, 
the first one, Fig. [5] (a) for the pseudo-fermion selfcnergy, 
which has a crucial role in particular for highly frustrated 
interactions (see Ref. I25I) . the second one, Fig. 0(b), for 
the two-particle vertex function. The /3-function of the 
latter has a contribution given by the three-particle ver- 
tex function. Following Katanin (Ref. [26||27| ) we approx- 
imate the three-particle vertex by the diagram shown in 
Fig. [2] (c). In this way the random phase approxima- 
tion (RPA) is recovered as a diagram subset, ensuring 
the qualitatively correct behavior on the approach to an 
ordered phase. Another way of saying this is that the 
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FIG. 2: The FRG scheme in diagrammatic form. Lines with- 
out a slash represent the Green's functions and lines with a 
slash the single-scale propagators. The different vertices are 
given by circles. The equations (a) and (b) show the FRG 
flow equations for the selfenergy and the two-particle vertex, 
respectively. Note that Eq. (b) does not distinguish between 
the particle-particle channel and the different particle-hole 
channels. For a full presentation see e.g. Ref. [25l . The 
Katanin truncation scheme is given by the replacement (c). 
In (d) the relation between the spin-correlation function \ 
and the two-particle vertex is displayed. 



conserving properties of the approximation (the Ward 
identities) are satisfied in a better way. It is worth noting 
that without the three-particle vertex contribution, RPA 
cannot be recovered. Keeping the contribution Fig. [5] (c) 
is formally equivalent to the replacement of the single 
scale propagator S A (iui) by —-£^G A (iu>) (where G A (iw) 
is the scale-dependent Green's functions). The approx- 
imation may be regarded as a natural extension of the 
usual one-loop truncation, in which all three-particle ver- 
tex contributions are discarded. On the other hand it is 
also important to keep all the terms consisting of two 
two-particle vertices on the r.h.s. of Fig. [2] (b), as they 
control disorder tendencies and therefore the size of the 
paramagnetic region. 

The FRG equations depicted in Fig.[3](a)-(c) are solved 
on the imaginary frequency axis and in real space, rather 
than in momentum space. The numerical solution re- 
quires a discretization on the frequency axis by a log- 
arithmic mesh. We found that it is essential to keep 
the full frequency dependence of the vertex function (3 
frequency variables). The spatial dependence is approxi- 
mated by keeping correlation functions up to a maximal 
length. As a result, for each set of discrete frequencies 
and site indices on external legs of a vertex function, one 
RG equation is obtained. For well converged results we 
typically need to keep sets of about 10 6 coupled ordinary 
differential equations. In the present formulation long- 
range order (LRO) is not taken into account. Therefore 



we should not find a stable solution of the equations down 
to A = in the parameter regimes where LRO is present. 
The existence of a stable solution therefore indicates the 
absence of LRO. It is worth to emphasize again that our 
FRG approach has no bias concerning magnetic LRO or 
a paramagnetic state. Our starting point of free, dispcr- 
sionless auxiliary fcrmions does not imply any tendency 
towards a certain state. 

The physical quantities of interest here, the spin sus- 
ceptibility and spin correlation function may be obtained 
from the diagrams depicted in Fig. [2] (d) . Below we dis- 
cuss results for the static susceptibilities as a function of 
the wave vector. In the ordered phases the susceptibil- 
ity at the fc-vector corresponding to the magnetic LRO 
is found to increase as the running cutoff A is decreased, 
until the solution becomes unstable below a certain value 
of A. Thus, the fc-vector characterizing the magnetic or- 
der at hand may be determined as that corresponding to 
maximal growth of the susceptibility. If the susceptibil- 
ities flow smoothly towards A = for any fc-vector, we 
are in a disordered phase. 



B. Coupled Cluster Method 

Next we analyze the system from a complementary 
viewpoint using the CCM, the main features of which we 
briefly illustrate now. For more details the reader is re- 
ferred to Refs. I2814321 and references therein. We mention, 
that the CCM has been applied successfully to determine 
the stability range of magnetically ordered ground state 
phases in frustrated quantum magnet s 8 ' 29 ' 32 " ^. More- 
over, it has been demonstrated that the CCM is ap- 
propriate to investigate frustrated quantum spin systems 
with incommensurate magnetic structure a 29 ' 32 i 38 ~ — . The 
starting point for a CCM calculation is the choice of a 
normalized reference state |<&), together with a set of mu- 
tually commuting multispin creation and destruction op- 
erators Cj" and Cy~, which are defined over a complete 
set of many-body configurations /. We choose C/} 
in such a way that we have (3>|C/ = = CJ |<f>), V/ 7^ 0. 
Note that the CCM formalism corresponds to the ther- 
modynamic limit N — > 00. Depending on the model 
parameters J\, J2 and J3 we have considered the Neel, 
the collinear, and the diagonal spiral state. Results on 
the (n, (j')-state could not be obtained at sufficient pre- 
cision. We work in a locally rotated frame of reference 
such that all spins of the reference state align along the 
negative z axis. Obviously, the choice of the rotated co- 
ordinate frame depends on the choice of the reference 
state |<fr). For a spiral reference state the local rotation 
angle is related to the pitch q. In the rotated coordi- 
nate frame the reference state reads |$) = | I) 
and we can treat each site equivalently. The corre- 
sponding multispin creation operators then can be writ- 
ten as Cf = Sj~, sfs'j', sfs^s^, ■ ■ ■ , where the indices 
fc, . . . denote arbitrary lattice sites. 

The CCM is based on ket and a bra ground states, \^>) 
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and (\&| respectively, which are parameterized as 
|*)=e s |$), S = ^S T C+, 

IjtO 

(*| = mSe~ s , 5 = 1 + ^5 7 C 7 -, (3) 

where the so-called correlation coefficients Si and Si are 
determined from the CCM equations 

($\Cje- s He s \$) = 0, (4) 
($|5e- s [ff,C*+]e s |$) = , (5) 

for each /. Using the Schrodinger equation, H\$) = 
Eq\*S!), the ground state energy can be written as E = 
(Q\e~ s He s \$>), whereas the magnetic order parameter is 

given by to = — JV=i(^l s ?l^)/(-^ s ) > wnere s l is ex- 
pressed in the rotated coordinate frame and s = 1/2 is 
the spin quantum number. We note, that for the spiral 
state the pitch vector q is used as a free parameter in the 
CCM calculation, which has to be determined by mini- 
mization of the CCM ground state energy with respect 
to q. 

In order to proceed, the operators S and S have to 
be truncated approximately. Here we use the well elab- 
orated LSUBrt scheme, where only n or fewer correlated 
spins in all configurations, which span a range of no 
more than n adjacent (contiguous) lattice sites, are in- 
cluded. The number of fundamental configurations can 
be reduced exploiting lattice symmetry and conservation 
laws. In the CCM-LSUB10 approximation we have fi- 
nally 29 605 (45 825) fundamental configurations for the 
Neel (collinear) reference state and for the CCM-LSUB8 
approximation we have finally 20 876 fundamental con- 
figurations for the spiral reference state. 

To obtain results at n — > oo, the 'raw' LSUBn data 
have to be extrapolated. While there are no a-priori rules 
to do so, a great deal of experience has been gathered for 
the GS energy and the magnetic order parameter. For 
the GS energy per spin Eo(n) = ao + ai(l/n) 2 + <22(l/n) 4 
is a reasonable well-tested extrapolation ansata^E— . 
An appropriate extrapolation rule for the magnetic or- 
der parameter for systems showing a GS order-disorder 
transition is m(n) = bo + frifl/n) 1 / 2 + ^(l/^) 3 ^ 2 with 
fixed exponents, see Refs. I34M371 Extrapolations m(n) — 
Co+Ci(l/n)° 2 , with a variable exponent ci have also been 
employed^ 2 .^^. 

C. Series Expansion 

Finally we highlight SE as the third approach which 
we employ. Our SE for the J1-J2-J3 model will not 
be carried out on Eq. ([1]), but on a Hamiltonian which 
is obtained by a continuous unitary transformation 
(CUT) 41 i 42 . This transformation is designed such as to 
pre-diagonalize the Hamiltonian with respect to a dis- 
crete 'particle' number Q which counts the number of 



excitation quanta within an eigenstate of the unperturbed 
spectrum. Therefore the SE can be carried out in spaces 
of fixed Q, which greatly reduces the computational com- 
plexity as compared to other SE methods. For the latter 
notions to be of reason, the unperturbed energy spec- 
trum has to be equidistant, which limits the particu- 
lar types of unperturbed Hamiltonians and phases which 
can be analyzed. Here we will consider CUT SE results 
for the J1-J2-J3 model which have been obtained from 
an unperturbed Hamiltonian which leads to a plaquette 
VBC ground state. I.e., in contrast to the CCM, the 
SE starts from the disordered phase. Using a plaque- 
tte VBC for this phase is motivated by results from ED, 
short-range resonating valence bond method a 19 ' 23 , and 
truncated dimer models^ 2 - which suggest that plaquette 
correlations in the QP state are dominant for J 2 < 0.5. 
The plaquette VBC will break only translational symme- 
try. Additional, sublcading columnar correlations, which 
have also been found recentl y 22 i 23 are not included. Some 
SE results for the phase diagram of the J1-J2-J3 model 
have been given in Ref. [2(| Here we extend this anal- 
ysis by also calculating the ground state energy and by 
comparison with FRG and CCM. CUT SE using pla- 
quette VBCs has been carried out for various systems 
recentl y 20 ' 43 " — and we refer the reader to there, for more 
details. To start, the Hamiltonian is decomposed into 

H = H + H x = HP(J 2 ) + Y, H^ m (Ji,J 2 , Js), (6) 

1 l,m 

where the first sum refers to a dense partitioning of the 
lattice in Fig. [1] a) into disjoint four-spin plaquettes, di- 
agonally crossed by two J 2 couplings and with J\ on the 
plaquettes set to unity. Ho(J2 = 0) has an equidistant 
energy spectrum. The second sum contains all inter- 
plaquette couplings, with (Ji, J2, J3) being the expansion 
parameters of the SE. After the CUT the Hamiltonian 
reads 

00 

H e fi = H + 2^ ^k.m^JlJ^J-} ) (?) 
k,m,l— 1 

where each Ck, m ,i are sums of weighted products of local 
and inter-plaquette operators O™, which create (n > 0) 
and destroy (n < 0) quanta due to J; within the lad- 
der spectrum of H (J2 = 0). The weights are fixed by 
Hq from a set of differential flow-equations 4 ^ and the Of 
are evaluated once for a given topology of exchange cou- 
plings Ji,2.3- We note that for the J1-J2-J3 model we 
find \n\ < 4. The main point is that the total number of 
quanta generated by each addend in the sum in Eq. ([7]) 
is zero. In turn, the eigenstates are classified by Q and 
their energy is obtained by diagonalizing H c fi within an 
dimensional space only, where V is the system size. 
For the ground state energy Q = and = d = 1, 
which implies that it is given by a single matrix clement 
of H e g , namely Eq = (0|-ff e ff|0), where |0) is the unper- 
turbed bare plaquette state. For one-particle excitations 
Q = 1 and d = N, which however, due to translational 
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invariance also reduces to = 1, where k refers to mo- 
mentum. Both, the weights and the operators in (|7|) can 
be evaluated exactly by arbitrary precision arithmetic 
codes, leading to analytic results. 



III. RESULTS 

A. Ground State Energy 

We have used CCM and SE to calculate the ground 
state energy E in the ordered and the QP phase, respec- 
tively. The ground state energy has also been obtained 
from ED on 32 sites, both, within the complete Hilbert 
space and for a nearest neighbor valence-bond basis^. 
PEPS calculations have also reported E , however for 
J2 = only^i. It is therefore instructive to compare re- 
sults from these various methods. This is shown in Fig. [31 
where we have extended the ED of Ref. [lj^ by calculat- 
ing more data points and considering also the ordered 
regimes at J2 = 0. The CCM data in this figure refers 
to extrapolations using LSUB4-10 (LSUB4-8) in the Neel 
(spiral) state, as detailed in section IlIBI The SE is cal- 
culated to 0(5) in J2.3 and the intcr-plaqucttc J±. The 
complete corresponding analytic expression is to lengthy 
to be displayed explicitly^, however at Ji=l and J2=0, 
as in the figure, it reduces to 

720160379 50524391297J 3 25907023Jf 
" ~ 1045094400 + 87787929600 34292160 
2377469Jf 198439J 3 4 1704733Jf 
+ 5598720 1128960 ~ 13547520 ( ' 

The SE result depicted refers to this bare series with no 
additional extrapolations performed. 

First we note that the classical energy, which is not 
contained in this figure, varies similar with J3 as com- 
pared to the other graphs plotted, however it is larger 
by ~ 0.17Ji on the average. Secondly, it is obvi- 
ous that PEPS is significantly higher than the other 
results^. This discrepancy is most pronounced in the 
ordered regimes, where Eq = —0.66953(4) is a best cur- 
rently available value from Quantum Monte-Carlo^ for 
the nearest neighbor Heisenberg model. On the other 
hand, both, CCM and SE are rather close to the ED. 
Each of them has been plotted up to the critical values 
J3 1 , J3 2 which define the extend of the ordered and QP 
phases as determined in the following section. At the 
endpoints CCM and SE match up acceptably, where the 
agreement at J3 1 is best and the convergence of the SE 
may be less reliable for J3 2 which is the larger. Thirdly, 
having in mind that the finite-size shift of the ED data 
for N = 32 is about +0.01, see Refs. [1113, it is remark- 
able that the CCM, ED and SE data almost coincide if 
J3 is not too large. The increase of the difference be- 
tween the ED and CCM data at larger J3 can be at- 
tributed to the crossover (i) of the characteristic length 
scale from nearest-neighbor (Ji -bonds) to 3rd-nearest- 




FIG. 3: Ground state energy at J 2 = 0: CCM, SE, and ED 
from this work, nearest-neighbor valence-bond (NNVB) basis 
from Ref. QJ, PEPS from Ref. HJ and quantum Monte-Carlo 
(QMC) from Ref. [SO- CCM extrapolation see text. All ener- 
gies are given in units of Ji . 

neighbor ( J3-bonds) separation and (ii) of the character- 
istic energy scale from J\ to J 3 . While the first crossover 
effect leads to an enhanced finite-size effect in the ED 
energy and to a larger impact of LSUBn clusters with 
n beyond those considered here, the second crossover ef- 
fect automatically enhances any discrepancy of energies 
roughly proportional to J 3 . Finally we note that, also en- 
ergies obtained from ED using a restricted nearest neigh- 
bor valence-bond basis^ agree very well with those from 
our CCM, SE, and complete Hilbert space ED. 



B. Quantum Phase Diagram 

Using FRG the phase diagram has been calculated in 
the J2- J3-plane with parameter steps of 0.1 for < J2.3 < 
1. A large computational effort is required to solve the 
system of FRG equations. In the present calculation we 
used 46 frequency points. The spatial dependence of the 
susceptibility was kept up to lattice vectors R satisfying 
Maxd-R^l, \Ry\) < 5, and the susceptibilities were put to 
zero beyond that range. This provides a correlation area 
of 11 x 11 lattice points, which proved to be sufficient for 
a first exploration of the phase diagram. The results were 
then Fourier transformed to momentum space. In mag- 
netic phases we see a pronounced susceptibility peak in 
momentum space that rapidly grows during the A-flow. 
At a certain A the onset of spontaneous LRO is signalled 
by a sudden stop of the smooth flow and the onset of os- 
cillations depending on the frequency discretization. On 
the other hand in non-magnetic phases a smooth flow 
and broad susceptibility peaks are obtained. This dis- 
tinction allows us to draw the FRG phase diagram of the 
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FIG. 4: Combined quantum phase diagram of the J1-J2- 
J3 model. Solid: Onset of magnetic flow from FRG on 
11x11 sites with 46 frequency points. Error bars of size 
0.1 (larger than 0.1) are due to the finite J2,3-mesh (uncer- 
tainties in the flow of the susceptibility). See text. Dashed: 
Lines of vanishing order parameter from LSUBn CCM with 
fixed(variable)-exponent extrapolations from n=4,6,8,10 for 
diamonds(circles). See text. Dashed-dotted: Triplet-gap 
closure from 5th-order CUT SE. Small(Large)- J3 lines are 
[3,l]([2,2])-DlogPade approximants. Shaded region refers to 
difference between bare series and DlogPades. 'N', 'C, and 
'S' denote Neel, collinear, and spiral state. 'QP' refers to a 
generic quantum paramagnet for CCM and FRG and to a 
plaquette VBC for SE. 



model, which is shown in Fig. |4j Regarding the error 
bars in Fig. 3] we note that bars of size 0.1 into the J3- 
direction do not reflect errors of the FRG, but are only 
due to finite ( J2, J3)-spacing and, in principle, apply also 
to the J2-dircction. However, especially near the phase 
boundary between the spiral ordered and the disordered 
phase, at large J3, we encounter enhanced uncertainties. 
Here (J2, ^-regions occur where it is not clear if the be- 
havior of the flow should be interpreted as magnetic or 
non-magnetic. In Fig. 0] these regions lead to error bars 
larger than 0.1. 

To obtain the CCM phase diagram we extrapolate the 
LSUBn data for the magnetic order parameter to, cf. 
section III Bl Starting in parameter regions where semi- 
classical magnetic long range order can be supposed we 
use the classical state as the reference state for the CCM. 
Then we obtain the phase boundaries of the magnetically 
ordered phases by determining the lines of vanishing mag- 
netic order parameter to, which implies continuous or 
second order transitions. In Fig. [5] we show typical CCM 
results for order to. For the Neel and the collinear phase 
we find the extrapolation of to to be nearly indepen- 
dent of the extrapolation scheme used. Unfortunately, 




FIG. 5: Magnetic order parameter m obtained within the 
CCM-LSUBn approximation as well as extrapolated data 
using the extrapolation scheme m(n) = bo + 6i(l/n) 1//2 + 
b 2 (l/n)' 3/2 and LSUBn data for n = 4,6,8,10, see Sec lITBl 
a) in the Neel phase, b) in the collinear phase. 



for the spiral state, computational constraints limit us 
to LSUBti with n < 8. Since the LSUB2 approximation 
is not appropriate for a proper description at larger J3, 
only 3 CCM data points are left for the extrapolation. 
In that case we find that the fixed and variable exponent 
extrapolations lead to rather different critical values for 
J3 at fixed J2- Therefore the critical regime of the spi- 
ral state cannot be determined accurately enough from 
the present CCM. This is very different for the ground 
state energy which allows for stable extrapolation in all 
three quasiclassical regions. The location of all (J2), 
with TO,(Jg (J2)) = 0, i.e. the quantum phase diagram as 
obtained from CCM is included in Fig.@]for both extrap- 
olation schemes. 

Finally the phase boundaries have been calculated us- 
ing SE. To this end the plaquette phase has been an- 
alyzed with respect to second order instabilities, i.e., a 
closure of the elementary triplet gap as a function of 
J2, Js- For this, we diagonalize i? fr in the Q=l sector, 
i.e., the subspace of single-quanta states |l)i at sites 1. 
These states are triplets. The sole action of i? e ff on these 
states is a translation in real space, H c q\\)o = Xd c i|l)i 
with the ci determined from the SE. Fourier transforma- 
tion yields the triplet dispersion, similar to a generalized 
tight-binding problem, with the hopping matrix elements 
determined from if c ff. For technical details we refer to 
Ref. H3- We have used this technique to calculate the 
triplet dispersion up to 5th order in all three variables 
Ji , J2 and J3 . In Fig. 0] we show the resulting lines for 
the closure of the triplet gaps, as obtained from a Dlog- 
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mum of the static susceptibility from FRG. Solid lines indicate 
the classical critical lines. Vertically, horizontally and diago- 
nally striped frames around the brackets correspond to Neel, 
collinear, and spiral state, respectively. Thin frames mark 
regions of uncertain flow behavior. 



Padc analysis of this dispersion. The shaded error-region 
refers to the distance between the critical lines from the 
bare SE and those from Dlog-Pade and are a measure of 
convergence of the SE. For J 2 > 0.5 the SE's convergence 
is insufficient to obtain reliable triplet dispersions. 

Figure [4] is a main result of our paper. Most obvi- 
ously, it shows that within the range of J2.3 investigated, 
the J1-J2-J3 model displays a large QP region. This re- 
gion extends well beyond the line J2 + J3 = 1/2, with 
J2 < 0.25 studied in R ef. Il9l . or the vicinity of the point 
J 2 ss J 3 ps 0.25 in Ref. [22|, and for J 2 < 0.5 also covers a 
larger J 3 interval than that observed in ED2£. The quan- 
tum Neel phase is enlarged with respect to the classical 
one, which agrees with early 1/S- analysis^ and recent 
ED results^. Our computational approaches are not ca- 
pable of an unbiased identification of the symmetry of the 
QP state. However, since the phase boundaries predicted 
from the plaquette SE and those from CCM and FRG 
agree rather well, our results corroborate substantial pla- 
quette correlations in the QP ph ase for J 2 < 0.3 .. .0.4, 
which is in line with Refs. Il9il2l|-[23l 



C. Short Range Correlations 

Since FRG evaluates the static susceptibility over the 
complete Brillouin zone, it allows to determine the wave 
vector k max of the dominant short-range magnetic corre- 
lations or the pitch vector of the magnetic order param- 
eter. These wave vectors are depicted in Fig. [5] together 




FIG. 7: Static susceptibility for wave vectors k x ,k y 6 [0, tt] 
for various values J2 and constant J3 = 0.4. The black dots 
mark the positions of the maxima. 



with the quantum phases discussed already in Fig. |4] 
Both, in the ordered as well as in the QP phase we find 
the wave vectors at maximum of the susceptibility to 
agree approximately with those obtained for the purely 
classical model in Fig.[T]b). This is particularly interest- 
ing with respect to the (tt, <7)-spiral state, which seems 
to exist only in the form of short range correlations in 
Fig. [6] 

In order to illustrate how the dominant fluctuations 
in the disordered phase change with varying couplings, 
we show in Fig. [7] results for the static susceptibility 
as a function of the fc-vector in the Brillouin zone with 
k xi k y G [0,7r] at fixed J3 = 0.4 for various values of 
J2. For J2 = we see a broadened peak at a (<?, ex- 
position which has already moved away from the Neel- 
point k = (7r,7r). This peak further moves along the 
Brillouin-zone diagonal for increasing J2. For J2 > 0.6 it 
is seen that the peak smoothly deforms into an arc and 
that the weight at the Brillouin-zone boundary increases. 
Between J 2 = 0.7 and J 2 = 0.8, close to the classical 
first order transition, the ridge has constant weight and 
the maximum jumps to a (tt, g)-direction to then further 
evolve towards the collinear points k = (0, 7r), k = (tt, 0) 
and to acquire more prominence. Therefore, remnants 
of the classical correlations survive into the QP regime. 
Very similar behavior is evidenced by ED2 3 .. 
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IV. CONCLUSION 

To summarize, we have studied the quantum phases 
of the frustrated planar J1-J2-J3 spin- 1/2 quantum- 
antiferromagnet, using FRG, CCM, and CUT SE. This 
includes evaluations of momentum resolved susceptibili- 
ties, the ground state energy, magnetic order parameters, 
and the elementary excitation gaps. Our results provide 
clear evidence for a sizeable quantum paramagnetic re- 
gion which opens up between the Neel, collinear, and 
spiral state of the purely classical model. A long-range 
ordered collinear spiral phase, which is also present classi- 
cally has not been observed in the quantum model in the 
parameter range we have investigated. Where applica- 
ble, the agreement between the critical lines determined 
from all three methods is remarkably good. While our 
computational approaches cannot determine potentially 
broken symmetries in the quantum paramagnetic state, 
the fact that the critical lines which we have obtained 
from FRG and CCM agree well with those from the CUT 
SE which is based on a plaqucttc VBC, is indicative of 
VBC ordering with substantial plaqucttc correlations in 
the quantum paramagnetic region - in those parameter 
ranges where CUT SE applies. Our results are consis- 
tent with second order transitions from the Neel and the 



collinear state into the quantum paramagnet. Unexpect- 
edly, our CCM results do not provide a definite signal 
of a transition from the spiral state into the quantum 
paramagnet. This may simply be related to an insuffi- 
cient order of the LSUBn approximation, but could also 
hint at a first order transition and an intermediate phase 
between the VBC and the spiral state. Finally, while 
our findings do not show a collinear spiral state as in the 
classical model, FRG convincingly demonstrates that the 
latter is replaced by corresponding short range correla- 
tions in the quantum paramagnetic region. 
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